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(57) Abstract: An image signal processing apparatus for converting an interlaced image signal to a progressive scanned image signal 
is provided. Image signals of three fields are acquired for each pixel by delaying each interlaced input image signal using two field 
memories connected in series. An intermediate signal is selected from the three signals, and intra-field interpolation or inter-field 
interpolation is performed using one of the signals depending on the selection result. Meanwhile, the difference between the image 
signals of the preceding and following fields is calculated. If the difference is not smaller than a reference value, the intra-field 
interpolation is automatically performed without selecting from the two interpolation methods. Such interpolated pixel values and 
the pixel values of the present field are alternately read at double speed. As a result, the progressive scanned image signal is obtained. 
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IMAGE SIGNAL PROCESSING CIRCUIT 

TECHNICAL FIELD 

The present invention relates to an image signal 
processing circuit for converting an interlaced image 
signal to a progressive scanned image signal. 

BACKGROUND ART 

Motion adaptive scanning line interpolation is known 
as a scanning line conversion technique for converting 
an interlaced image signal to a progressive scanned image 
signal.- In motion adaptive scanning line interpolation, 
motion of an image is detected. When the image is a still 
image, an interpolated scanning line is generated using 
an image signal of a field preceding a present field 
according to inter-field interpolation. When the image 
is a moving image, an interpolated scanning line is 
generated using an image signal of the present field 
according to intra-field interpolation. To perform 
motion adaptive scanning line interpolation, a large- 
scale motion detection circuit is necessary. 

Japanese Laid-Open Patent Application No. HO 9- 
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224223 discloses an image signal processing circuit that 
can generate favorable images by switching between 
intra-f ield interpolation and inter-field interpolation, 
with no need to employ a motion detection circuit. 
5 FIG. 19 is a block diagram showing an example of such 

an image signal processing circuit. 

The image signal processing circuit shown in the 
drawing is roughly made up of field memories 21 and 22, 
an interpolation circuit 23, an intermediate value 

10 selection circuit 24, double-speed conversion memories 
26 and 27, and a selection circuit 28. 

An interlaced image signal is input in an input 
terminal 10. The input image signal is then output to the 
field memory 21 and the intermediate value selection 

15 circuit 24. The field memory 21 outputs the image signal 
after a delay of one field. The image signal output from 
the field memory 21 is passed to the field memory 22 , the 
interpolation circuit 23, and the double-speed conversion 
memory 27. The field memory 22 outputs the image signal 

20 passed from the field memory 21, after a delay of one field. 

Suppose an image signal output from the field memory 
21 is an image signal of the nth field. Then an image 
signal input in the input terminal 10 is an image signal 
of the (n+1) th field, and an image signal output from the 

25 field memory 22 is an image signal* of the (n-l)th field. 
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Here, n is a positive integer. 

The interpolation circuit 23 generates an 
interpolation signal from pixels in the nth field, using 
the image signal of the nth field passed from the field 

5 memory 21- 

The intermediate value selection circuit 24 receives 
the image signal output from the field memory 22, the 
interpolation signal generated by the interpolation 
circuit 23, and the image signal input in the input 

10 terminal 10. Here, let A be a pixel value of the image 
signal output from the field memory 22, B be a pixel value 
of the interpolation signal output from the interpolation 
circuit 23, and C be a pixel value of the image signal 
input in the input terminal 10. 

15 The intermediate value selection circuit 24 compares 

pixel values A, B, and C for each pixel period. The 
intermediate value selection circuit 24 selects an 
intermediate value from pixel values A, B, and C, and 
outputs the selected pixel value to the double-speed 

20 conversion memory 26- Thus, pixel values output from the 
intermediate value selection circuit 24 are sequentially 
stored in the double-speed conversion memory 26. 
Meanwhile, pixel values of image signals input in the input 
terminal 10 are sequentially stored in the double-speed 

25 conversion memory 27. 
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FIG. 20 shows conditions used by the intermediate 
value selection circuit 24 to determine an intermediate 
value. As shown in the drawing, pixel value A is selected 
when C>A>B or J5^A>C. Pixel value B is selected when A>B>C 
5 or CtBtA. Pixel value C is selected when A>C>B or B>CtA. 

The selection circuit 28 alternately reads the pixel 
values from the double-speed conversion memory 2 6 and the 
pixel values from the double-speed conversion memory 27 
and outputs them to an output terminal 20, in a period 
10 which is half the pixel period of the image signal input 
in the input terminal 10. As a result, a progressive 
scanned image signal is obtained in the output terminal 
20 . 

Thus, when pixel value A of the (n-l)th field is 
15 judged as being an intermediate value, an interpolated 
scanning line is generated by inter-field interpolation 
using the image signal of the (n-1) tb field. When pixel 
value B is judged as being an intermediate value, an 
interpolated scanning line is generated by intra-field 
20 interpolation using the image signal of the nth field. 
When pixel value C of the (n+l)th field is judged as being 
an intermediate value, an interpolated scanning line is 
generated by inter-field interpolation using the image 
signal of the (n+l)th field. 
25 The aforementioned patent application also 
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discloses a method of inter-field interpolation that uses 
vertical components of high frequencies in the image 
signal of the preceding or following field. In this 
specification, the term "vertical high-frequency 
5 components" means that values of pixels which are adjacent 
in the vertical direction vary greatly, i.e. that the 
spatial frequency is high. 

A specific example of this inter-field interpolation 
method that uses vertical high-frequency components is 
10 explained below, with reference to FIGS. 21 and 22. 

FIG. 21 shows pixels of the (m-1) th line, mth line, 
and (m+l)th line in each of the (n-1) th, nth, and (n+1) th 
fields across a time axis (a horizontal axis) . Circles 
in solid line represent pixels which exist in interlaced 
15 images, whereas circles in broken line represent pixels 
which do not exist in the interlaced images. The pixels 
of the nth field are shifted from the pixels of the fn-i; th 
field and the pixels of the (n+l)th field by half the line 
width, which is the property of interlacing. 
20 In the drawing, PC, PB, and PA denote the values of 

the pixels of the (m-1) th, mth, and (m+Dth lines in the 
(n-1) th field, respectively. MD, MC, MB, and MA denote 
the values of the pixels of the (m-l)th, mth, (m+l)th, 
and (m+2)th. lines in the nth field, respectively. SC, SB, 
25 and SA denote the values of the pixels of the (m-l)th, 
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mth, and (m + 1) th lines in the (n + 1) th field, respectively. 
Note that m is a positive integer. 

The following explanation deals with the case where 
a pixel shown by a diagonally shaded circle in the nth 
5 field is interpolated. In the drawing, IN denotes the 
value of the pixel to be interpolated (hereafter referred 
to as an "interpolation pixel value" ) . 

First, pixel value PB of the (n-l)th field, 
interpolation value M of the nth field, and pixel value 
10 SB of the (n + l)t,h field are compared to select an 

intermediate value. Based on this selection, one of the 
following interpolation values a, b, and c is selected 
as interpolation pixel value IN. Note here that 
M=(MB+MC) /2* 

15 Interpolation values a, b, and c are calculated from 

the following equations- 

a={2xPB- (PA+PC) }/4+{lx(MA+MD) +5x(MB+MC) }/12 

(Equation 1) 

20 

b= (MB+MC) /2 (Equation 2) 

c={2xSB- (SA+SC) }/4+{lx(MA+MD) +5x(MB+MC) }/12 

(Equation 3) 

25 

6 
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FIG . 22 shows conditions for determining an 
intermediate value in the scanning line interpolation 
shown in FIG- 21. As illustrated, interpolation value a 
is selected as interpolation pixel value IN when SBtPB^M 
5 or M>PB>SB. Interpolation value b is selected as 

interpolation pixel value IN when PB>M>SB or SBtMtPB. 
Interpolation value c is selected as interpolation pixel 
value IN when PB >SBtM or M>SB>PB. 

Which is to say, when pixel value PB of the (n-l)-tti 

10 field is judged as being an intermediate value, 

interpolation value a is selected as interpolation pixel 
value IN. When interpolation value M of the nth field is 
judged as being an intermediate value, interpolation 
value b is selected as interpolation pixel value IN. When 

15 pixel value SB of the fn + 2;th field is judged as being 
an intermediate value, interpolation value c is selected 
as interpolation pixel value IN. Here, the first term of 
the right side of the Equation 1 is { 2xPB- (PA+PC) } . This 
being so, if PA=PB=PC, the calculation outcome is 0. In 

20 other words, the first term of Equation 1 has the following 
property. If values of pixels adjacent in the vertical 
direction do not vary greatly, the calculation outcome 
is small . If, on the other hand, the values of the adjacent 
pixels vary greatly, the calculation outcome is large. 

25 That is to say, high-frequency components result in a 
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larger calculation outcome than low-frequency components . 
The same applies to the first term of Equation 3, where 
high-frequency components result in a larger calculation 
outcome . 

5 The reason for employing such an inter-field 

interpolation method whereby interpolation pixel value 
IN is affected to a greater extent when the absolute values 
of vertical high-frequency components are larger in the 
preceding or following field is given below. A moving 

10 image has high-frequency components . Accordingly, if the 
spatial frequency of an image which contains the pixel 
selected as the intermediate value is high, reflecting 
such a spatial frequency upon" the interpolation pixel 
value makes the resulting image appear to change naturally 

15 with time. When interpolating horizontal scanning lines 
as in the case of interpolation from interlacing to 
progressive scanning, movement in the horizontal 
direction is not a concern, so long as movement in the 
vertical direction is taken into account. Hence it is 

20 rational to perform interpolation using vertical 
high-frequency components. 

However, the inventors of the present application 
found that this interpolation method can cause the 
occurrence of noise in some particular cases. A specific 

25 example of this is given below. 
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Suppose pixel values FA, MA, MB, MC, MD, SA, and SC 
are 100, pixel value SB is 50, pixel value PB is 10, and 
pixel value PC is 0. The nth field is an image in which 
each pixel has the same pixel value. In this case, 
5 interpolation value Mis 100. Since P£<M, PB<SB, and M>SB, 
interpolation value c is selected as interpolation pixel 
value IN, which is expressed as follows: 

IN=c={ 2x50- (100 + 100) }/4 
10 + {lx(100 + 100) +5x(100 + 100) }/12=75 

This value greatly differs with the desired output 
value 100. As a result, noise appears in the resulting 
progressive scanned image. This is caused by the 
15 following reason- Since the above image signal 

processing circuit does not use amotion detection circuit, 
inter-field interpolation is performed even when the 
movement of the input image signal is large. 

20 DISCLOSURE OF INVENTION 

The present invention was conceived in view of the 
problem described above, and has a primary object of 
providing an image signal processing circuit that can 
perform inter-field interpolation while minimizing the 

25 occurrence of noise. 

9 

BNSDOCID: <WO 0237847A1_I_> 



WO 02/37847 PCT/JPO 1/093 71 

The stated object can be achieved by an image signal 
processing apparatus for converting an image signal of 
a first scanning format to an image signal of a second 
scanning format, including: amain interpolating unit for 
5 interpolating a scanning line between any two adjacent 
scanning lines in a present field that corresponds to the 
image signal of the first scanning format, by selectively 
executing two interpolation methods for each target pixel 
which constitutes the scanning line to be interpolated, 

10 the two interpolation methods being inter-field 

interpolation that uses pixels of a field preceding the 
present field and a field following the present field, 
and intra-field interpolation that uses pixels in the 
present field which are in a neighborhood of the target 

15 pixel; a change detecting unit for detecting a change of 
an image, by referring to an image signal of the preceding 
field and an image signal of the following field; an 
automatic interpolating unit for prohibiting, depending 
on a detection result obtained by the change detecting 

20 unit, the main interpolating unit to select and execute 
one of the two interpolation methods, and instead 
automatically executing a specific interpolation method; 
and an image signal outputting unit for alternately 
outputting scanning lines of the image signal of the 

25 present field and interpolated scanning lines obtained 

10 
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by the combination of the main interpolating unit, the 
change detecting unit, and the automatic interpolating 
unit . 

Here, the change detecting unit may detect an extent 
5 to which the image changes with time, wherein the automatic 
interpolating unit automatically executes the intra- 
field interpolation, when the detected extent is greater 
than a reference value. 

Here, the first scanning format may be interlace 
10 scanning, and the second scanning format progressive 
scanning, wherein the image signal outputting unit 
outputs a progressive scanned image signal of one frame, 
responsive to an interlaced image signal of one field. 
Here, the change detecting unit may calculate a 
15 difference between a value of a pixel in the preceding 
field that positionally corresponds to the target pixel 
and a value of a pixel in the following field that 
positionally corresponds to the target pixel, and judge 
whether the difference is greater than the reference 
20 value . 

Here, when the present field is an nth field, the 
preceding field may be an (n-1) th field and the following 
field an (n+1) th field, wherein the main interpolating 
unit is equipped with a series circuit of at least two 
25 field memories, and when the image signal of the (n+l)th 
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field is being input in a field memory of a first stage 
in the series circuit, the image signal of the nth field 
is being output from the field memory of the first stage 
and the image signal of the (n-l)th field is being output 
5 from a field memory of a second stage in the series circuit . 

Here, the main interpolating unit may include: an 
intermediate value selecting unit for selecting an 
intermediate value from (a) the value of the pixel in the 
(n-l)th field that positionally corresponds to the target 
10 pixel, (b) the value of the pixel in the (n-hl)th field 
that positionally corresponds to the target pixel, and 
(c) an average value of pixels in the nth field that are 
adjacent to the target pixel, the intermediate value being 
smaller than one of remaining two values but greater than 
15 a different one of the remaining two values; a first 
inter-field interpolating unit for obtaining high- 
frequency components from values of pixels in the (n- 
l)th field that are made up of the pixel positionally 
corresponding to the target pixel and neighboring pixels 
20 thereof, and calculating a first interpolation value for 
the target pixel using the high-frequency components; a 
second inter-field interpolating unit for obtaining 
high-frequency components from values of pixels in the 
(n + l)th field that are made up of the pixel positionally 
25 corresponding to the target pixel and neighboring pixels 

12 
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thereof, and calculating a second interpolation value for 
the target pixel using the high-frequency components; an 
intra-field interpolating unit for calculating a third 
interpolation value for the target pixel, using an average 
5 value of the pixels in the nth field that are in the 
neighborhood of the target pixel; and a selecting unit 
for selecting one of the first inter-field interpolating 
unit, the second inter-field interpolating unit, and the 
intra-field interpolating unit based on the intermediate 
10 value selected by the intermediate value selecting unit, 
and outputting an interpolation value calculated by the 
selected interpolating unit to the image signal 
outputting unit as a pixel value of the target pixel. 

Here, the reference value may be set at a value in 
15 a range of 7 to 16, when the image is expressed in 256 
levels of gray- 
Here, the change detecting unit may calculate a 
difference between an average value of a pixel group in 
the preceding field and an average value of a pixel group 
20 in the following field, and judge whether the difference 
is greater than the reference value, each pixel group being 
made up of a pixel that positionally corresponds to the 
target pixel and neighboring pixels thereof. 

Here, the image signal processing apparatus may 
25 further include: an edge detecting unit for detecting an 
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edge in the preceding field or the following field, the 
edge being parallel to a scanning line that includes a 
pixel positionally corresponding to the target pixel; and 
a stopping unit for temporarily stopping the automatic 
5 interpolating unit from prohibiting the main 

interpolating unit, when the edge detecting unit detects 
the edge . 

The stated object can also be achieved by an image 
signal processing apparatus for converting an image 

10 signal of a first scanning format to an image signal of 
a second scanning format, including: a main interpolating 
unit for interpolating a scanning line between any two 
adjacent scanning lines in a present field that 
corresponds to the image signal of the first scanning 

15 format, by selectively executing inter-field 

interpolation and intra-f ield interpolation to calculate 
a first interpolation value for each target pixel which 
constitutes the scanning line to be interpolated, the 
inter-field interpolation using pixels of a field 

20 preceding the present field and a field following the 
present field, and the intra-field interpolation using 
pixels in the present field that are in a neighborhood 
of the target pixel; a sub-interpolating unit for 
executing the intra-field interpolation to calculate a 

25 second interpolation value for the target pixel, using 

14 



BNSDOCID: <WO 0237847A1_I_> 



WO 02/37847 



PCT/JP01/09371 



the pixels in the present field that are in the 
neighborhood of the target pixel; a change detecting unit 
for detecting a change of an image, by referring to an 
image signal of the preceding field and an image signal 
5 of the following field; a weight setting unit for setting 
a first weight by which the first interpolation value 
should be multiplied, and a second weight by which the 
second interpolation value should be multiplied; a 
weighting/adding unit for multiplying, depending on a 

10 detection result obtained by the change detecting unit, 
the first interpolation value by the first weight and the 
second interpolation value by the second weight, and 
calculating a sum of the weighted first interpolation 
value and the weighted second interpolation value, the 

15 sum being set as a value of the target pixel; and an image 
signal outputting unit for alternately outputting 
scanning lines of the image signal of the present field 
and interpolated scanning lines obtained by the 
combination of the main interpolating unit , the sub- 

20 interpolating unit, the change detecting unit, the weight 
setting unit, and the weighting/adding unit. 

Here, the weight setting unit may set the first 
weight and the second weight, in accordance with the 
difference obtained for the target pixel and differences 

25 obtained for pixels in the present field that are subjected 

15 
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to interpolation and are in a neighborhood of the target 
pixel. 

Here, the weight setting unit may set the first 
weight and the second weight, in accordance with the 
5 difference calculated by the change detecting unit. 

The stated object can also be achieved by an image 
signal processing apparatus for interpolating necessary 
scanning lines, when converting an interlaced image 
signal to a progressive scanned image signal, including: 

10 a first interpolating circuit for generating an 

interpolation value M for each target pixel which 
constitutes a scanning line to be interpolated in an nth 
field that corresponds to the interlaced image signal, 
by performing interpolation within the nth field; an 

15 intermediate value selecting circuit for selecting an 
intermediate value from (a) a value P of a pixel in an 
(n-1 )th field that positionally corresponds to the target 
pixel, (b) a value S of a pixel in an (n + 1 ) th field that 
positionally corresponds to the target pixel, and (c) the 

20 interpolation value M, the intermediate value being 

smaller than one of remaining two values but greater than 
a different one of the remaining two values; a difference 
judging circuit for calculating a difference AL using an 
image signal of the (n-l)th field and an image signal of 

25 the fn+l>th field, and outputting a judgement result based 
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on a comparison between the difference AL ai;d a reference 
value R; and a target pixel generating circuit for 
outputting, as a value of the. target pixel, (a) the 
interpolation value M, when the difference judging 
5 circuit judges AL>R or the intermediate value selecting 
circuit selects the interpolation value M, (b) a first 
interpolation value for the target pixel which is 
generated by performing first inter-field interpolation 
that uses at least the image signal of the (n-l)th field, 

10 when the difference judging circuit judges AL<R and the 
intermediate value selecting circuit selects the value 
P, and (c) a second interpolation value for the target 
pixel which is generated by performing second inter-field 
interpolation that uses at least the image signal of the 

15 (n+D-th field, when the difference judging circuit judges 
AL*R and the intermediate value selecting circuit selects 
the value 5. 

Here, the target pixel generating circuit may 
include; a first high-frequency component extracting 

20 circuit for extracting high-frequency components from 
pixels in the (n-l)th field which are consecutive in a 
vertical direction; a second high-frequency component 
extracting circuit for extracting high-frequency 
components from pixels in the (n+1) th field which are 

23 consecutive in the vertical direction; a second 

17 
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interpolating circuit for generating a third 
interpolation value for the target pixel, by performing 
interpolation within the nth field; a first calculating 
circuit for performing a calculation, using the high- 
frequency components extracted by the first high- 
frequency component extracting circuit and the third 
interpolation value; and a second calculating circuit for 
performing a calculation, using the high-frequency 
components extracted by the second high-frequency 
component extracting circuit and the third interpolation 
value, wherein a result of the calculation by the first 
calculating circuit is the first interpolation value, 
whereas a result of the calculation by the second 
calculating circuit is the second interpolation value. 

The stated object can also be achieved by an- image 
signal processing apparatus for interpolating necessary 
scanning lines, when converting an interlaced image 
signal to a progressive scanned image signal, including: 
a first interpolating circuit for generating an 
interpolation value M for each target pixel which 
constitutes a scanning line to be interpolated in an nth 
field that corresponds to the interlaced image signal, 
by performing interpolation within the nth field; an 
intermediate value selecting circuit for selecting an 
intermediate value from (a) a value P of a pixel in an 
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(n-1) th field that positionally corresponds to- the target 
pixel, (b) a value 5 of a pixel in an (n+2;th field that 
positionally corresponds to the target pixel, and (c) the 
interpolation value M, the intermediate value being 

5 smaller than one of remaining two values but greater than 
a different one of the remaining two values; a difference 
judging circuit for calculating a difference AL using an 
image signal of the (n-1) th field and an image signal of 
the (n + 1) th field, and outputting a judgement result based 

10 on a comparison between the difference AL and a reference 
value R; a first high-frequency component extracting 
circuit for extracting high-frequency components from 
pixels in the (n-1) th field which are consecutive in a 
vertical direction; a second high-frequency component 

15 extracting unit for extracting high-frequency components 
from pixels in the (n+l)th field which are consecutive 
in the vertical direction; a second interpolating circuit 
for generating a first interpolation value for the target 
pixel, by performing interpolation within the nth field; 

20 a first calculating circuit for performing a calculation, 
using the high-frequency components extracted by the 
first high-frequency component extracting circuit and the 
first interpolation value; a second calculating circuit 
for performing a calculation, using the high-frequency 

25 components extracted by the second high-frequency 
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component extracting circuit and the first interpolation 
value; a selecting circuit for selecting and outputting 
(a) the interpolation value M, when the intermediate value 
selecting circuit selects the interpolation value M, (b) 
5 a result of the calculation by the first calculating 
circuit, when the intermediate value selecting circuit 
selects the value P, and (c) a result of the calculation 
by the second calculating, circuit, when the intermediate 
value selecting circuit selects the value 5; a third 

10 interpolating circuit for generating a second 

interpolation value for the target pixel, by performing 
interpolation within the nth field; a weight setting 
circuit for setting a first weight by which an output value 
of the selecting circuit should be multiplied and a second 

15 weight by which the second interpolation value should be 
multiplied, according to the judgement result by the 
difference judging circuit; and a weighting/adding 
circuit for multiplying the output value of the selecting 
circuit by the first weight and the second interpolation 

20 value by the second weight, and outputting a sum of the 
weighted values as a value of the target pixel, 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 shows an image signal processing circuit to 
25 which the first embodiment of the present invention 
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relates . 

FIG. 2 shows a construction of a difference judgement 
circuit shown in FIG. 1. 

FIG. 3 shows a detailed construction of an 
5 intermediate value selection circuit shown in FIG. 1. 

FIG. 4 shows a specific example of an intermediate 
value judgement circuit shown in FIG. 3. 

FIG. 5 is a truth table used for a selection operation 
by a selection circuit shown in FIG. 3. 
10 FIG. 6 shows an example image subjected to an 

interpolation operation. 

FIG. 7 shows a pixel pattern of each field of the 
image shown in FIG . 6 . 

FIG. 8 shows another example image subjected to an 

15 interpolation operation. 

FIG. 9 shows a pixel pattern of each field of the 
image shown in FIG. 8. 

FIG. 10 shows another example image subjected to an 
interpolation operation. 
20 FIG. 11 shows a pixel pattern of each field of the 

image shown in FIG. 10. 

FIG. 12 shows an image signal processing circuit to 
which the second embodiment of the invention relates. 
FIG. 13 shows a specific construction of an 
25 intermediate value selection circuit shown in FIG. 12. 
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FIG. 14 shows an example of weighting by a weighting 
factor setting circuit shown in FIG. 12, 

FIG. 15 shows an image signal processing circuit to 
which the third embodiment of the invention relates. 
5 FIG. 16 illustrates the principle of edge detection. 

FIG. 17 shows an image for which interpolation of 
the third embodiment is effective. 

FIG. 18 shows an interpolation operation performed 
on the image shown in FIG. 17. 
10 FIG. 19 shows a conventional image signal processing 

circuit. 

FIG. 20 is a table showing the conditions of judging 
an intermediate value by an intermediate value selection 
circuit shown in FIG. 19. 
15 FIG. 21 shows pixels of three fields which are 

subjected to an interpolation operation of the image 
signal processing circuit shown in FIG. 19. 

FIG. 22 shows the conditions of judging an 
intermediate value in the interpolation shown in FIG. 21. 

20 

BEST MODE FOR CARRYING OUT THE INVENTION 
(First Embodiment) 

FIG. 1 shows a construction of an image signal 
processing circuit which is the first embodiment of the 
25 present invention. This image signal processing circuit 
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is roughly made up of field memories 1 and 2, an 
interpolation circuit 3, an intermediate value selection 
circuit 4, a difference judgement circuit 5, double-speed 
conversion memories 6 and 7, and a selection circuit 8. 
5 An interlaced image. signal is input in an input 

terminal 10 . The input image signal is passed to the field 
memory 1, the intermediate value selection circuit 4, and 
the difference judgement circuit 5. 

The field memories 1 and 2 and the interpolation 

10 circuit 3 are the same as those explained in the background 
art, though they are briefly explained once again. 

The field memory 1 outputs the image signal after 
a delay of one field. The output image signal is 
synchronous with the input image signal, with the 

15 corresponding pixels being output one at a time. The 
image signal output from the field memory 1 is supplied 
to the field memory 2, the interpolation circuit 3, the 
intermediate value selection circuit 4, and the 
double-speed conversion memory 7 pixel by pixel in the 

20 output order. The field memory 2 has the same 

construction as the field memory 1, and outputs the input 
image signal after a delay of one field. Suppose an image 
signal output from the field memory 1 is an image signal 
of the nth field. Then an image signal input in the input 

25 terminal 10 is an image signal of the (n+1) th field, and 
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an image signal output from the field memory 2 is an image 
signal of the (n-l)th field. Here, n is a positive 
integer . 

The interpolation circuit 3 generates an 
5 interpolation signal from pixels of the nth field, using 
the image signal of the nth field given from the field 
memory 1. The intermediate value selection circuit 4 is 
given the image signal output from the field memory 2, 
the interpolation signal generated by the interpolation 

10 circuit 3, and the image signal input in the input terminal 
10. The pixels which are simultaneously input in the 
intermediate value selection circuit 4 are pixels of the 
different fields which are located at the same pixel 
position on a screen. 

15 Let P be a pixel value of the image signal output 

from the field memory 2, M be a pixel value of the 
interpolation signal (such a pixel value is hereafter 
referred to as an M interpolation value") output from the 
interpolation circuit 3 f S be a pixel value of the image 

20 signal input in the input terminal 10, and N be a pixel 
value of the image signal output from the field memory 
1. 

The difference judgement circuit 5 receives image 
signal S of the (n+l)t.h field from the input terminal 10, 
25 and image signal P of the (n-l)th field from the field 
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memory 2. The difference judgement circuit 5 calculates 
the difference between the values of the corresponding 
pixels in both fields, and compares the difference with 
a reference value stored therein. The difference 
5 judgement circuit 5 then outputs comparison result a. 
When the difference is equal to or greater than the 
. reference value, ce=l . When the difference is smaller than 
the reference value, a=0 . The difference judgement 
circuit 5 can be made up of a subtractor and a comparator, 
10 as shown in FIG. 2. The subtractor calculates absolute 
value (\S-P\) of the difference between the corresponding 
pixel values of image signal S of the (n+l)t.h field and 
image signal P of the . (n-1) th field. The comparator 
compares the absolute value output from the subtractor, 
15 with reference value R given to a comparison terminal. 
The comparator then outputs comparison result a. As 
reference value R, an adequate value is selected from 7 
to 16 for instance. It should be noted that this value 
is limited to the case where an image is expressed in 256 
20 {=2 8 ) levels of gray. Therefore, a different reference 
value should be used if the total number of gray levels 
is different. A method of setting the reference value is 
explained in more detail later. 

The intermediate value selection circuit 4 performs 
25 two types of operations, depending on the value of 
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comparison result a. If a=0, the intermediate value 
selection circuit 4 compares pixel value P, interpolation 
value M, and pixel value S for each pixel period, and judges 
which of P, M, and S is an intermediate value. The 

5 intermediate value selection circuit 4 selects inter- 
field interpolation or intra-field interpolation based 
on the judgement result, and outputs interpolation pixel 
value IN. If a-1, on the other hand, the intermediate 
value selection circuit 4 automatically performs 

10 intra-field interpolation, without comparing the pixel 
values. The result of this interpolation is output as 
interpolation pixel value IN. A construction of this 
intermediate value selection circuit 4 is shown in FIG. 
3, which is explained in greater detail later. 

15 The double-speed conversion memory 6 sequentially 

stores interpolation pixel values IN output from the 
intermediate value selection circuit 4. Meanwhile, the 
, double-speed conversion memory 7 sequentially stores 
pixel values N of image signals output from the field 

20 • memory 1. The double-speed conversion memories 6 and 7 
each have at least two line memories. In each of the 
double-speed conversion memories 6 and 7, an operation 
in which a pixel value (or an interpolation pixel value) 
is written in one line memory while a pixel value (or an 

25 interpolation pixel value) written in the other line 
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memory is read can be performed alternately on the line 
memories . 

The selection circuit 8 alternately reads 
interpolation pixel values IN of one readable line from 
5 the double-speed conversion memory 6, and pixel values 
N of one readable line from the double-speed conversion 
memory 7 . The speed of reading one pixel is half the pixel 
period of the image signal input in the input terminal 
10. As a result, a progressive scanned image signal is 
10 obtained in an output terminal 20. The selection circuit 
8 can be realized by a multiplexer (not shown in the 
drawing) . 

FIG. 3 is a block diagram showing a construction of 
the intermediate value selection circuit 4 in the image 

15 signal processing circuit of FIG. 1. As shown in the 
drawing, the intermediate value selection circuit 4 
includes an intermediate value judgement circuit 30, 
vertical high-pass filters 31 and 32, adders 33 and 34, 
an interpolation circuit 35, and a selection circuit 36. 

20 The intermediate value judgement circuit 30 receives 

pixel value P of the image signal of the (n-1) th field 
output from the field memory 2 shown in FIG. 1, 
interpolation value M of the interpolation signal output 
from the interpolation circuit 3, and pixel value S of 

25 the image signal of the (n+1) th field input in the input 
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terminal 10 . 

The intermediate value judgement circuit 30 compares 
pixel value P of the image signal of the (n-l)th field, 
intra-field interpolation value M of the nth field, and 

5 pixel value S of the image signal of the (n+l)th field, 
to judge which of P, M, and S is an intermediate value. 
The intermediate value judgement circuit 30 outputs the 
judgement result to the selection circuit 36. A specific 
example of the intermediate value judgement circuit 30 

10 is shown in FIG . 4. In the drawing, judgement' circuits 
211a-211c judge the inequality of any two values out of 
three image signals P, M, and S. AND circuits 212a-212f 
determine the inequality of three image signals P, M, and 
S based on the judgement result of each judgement circuit. 

15 OR circuits 213a-213c output an intermediate value 
selected from image signals P, M, and S . 

The vertical high-pass filter 31 shown in FIG. 3 is 
given pixel value S of the image signal of the (n + Dth. 
field from the input terminal 10, whereas the vertical 

20 high-pass filter 32 is given pixel value P of the image 
signal of the (n-l)th field from the field memory. 2. 

The vertical high-pass filter 31 extracts vertical 
high-frequency components of the image signal of the. . 
(n+l)th field. The vertical high-pass filter 32 extracts 

25 vertical high-frequency components of the image signal 
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of the (n-1) th field. The vertical high-pass filters 31 
and 32 are realized by circuits that compute the first 
terms of the right sides of Equations 3 ■ and 1 shown in 
the background art, using, for instance, values of three 

5 vertically-adjacent pixels in the image signals of the 
(n+l)th and (n-l)th fields. 

The interpolation circuit 35 generates an 
interpolation value, by performing interpolation using 
vertically-adjacent pixels in the image signal of the nth 

10 field output from the field memory 1. The interpolation 
circuit 35 can be realized by a circuit that computes the 
second terms of the right sides of Equations 1 and 3 . The 
term w vertical high-frequency component" has been defined 
in the description of the background art. 

15 The adder 33 weights the output value of the vertical 

high-pass filter 32 and the interpolation value output 
from the interpolation circuit 35. The adder 33 then adds 
the weighted output value and interpolation value, and 
outputs the sum to the selection circuit 3 6 as 

20 interpolation value a. The adder 34 weights the output 
value of the vertical high-pass filter 31 and the 
interpolation value output from the interpolation circuit 
35. The adder 34 then adds the weighted output value and 
interpolation value, and outputs the sum to the selection 

25 circuit 36 as interpolation value c. Also, interpolation 
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value M output from the interpolation circuit 3 shown in 
FIG. 1 is input to the selection circuit 36 as 
interpolation value jb. As can be understood from FIG. 3, 
interpolation values a, £>, and c are given by Equations 

5 1, 2, and 3 shown in the background art. 

The selection circuit 36 selects one of 
interpolation value a output from the adder 33, 
interpolation value Jb output from the interpolation 
circuit 3, and interpolation value c output from the adder 

10 34, based on the judgement result of the intermediate value 
judgement circuit 30 and judgement result or of the 
difference judgement circuit 5. The selection circuit 36 
outputs the selected interpolation value as interpolation 
pixel value IN. 

15 As shown in a truth table of FIG. 5, if the • 

intermediate value judgement circuit 30 judges pixel 
value P as being an intermediate value and if a=0, the 
selection circuit 36 outputs interpolation value a as 
interpolation pixel value IN. If the intermediate value 

20 judgement circuit 30 judges interpolation value Mas being 
an intermediate value or if a=l, the selection circuit 
36 outputs interpolation value b as interpolation pixel 
value IN. If the intermediate value judgement circuit 30 
judges pixel value S as being an intermediate value and 

25 if a*=0, the selection circuit 36 outputs interpolation 
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value c as interpolation pixel value IN. 

Thus, when pixel value P of the image signal of the 
(n-1) th field is judged as being an intermediate value 
and the difference between the image signals of the (n-i;th 

5 and fn+i;th fields is below the reference value, 

interpolation pixel value IN is generated by inter-field 
interpolation that uses the vertical high-frequency 
components of the image signal of the (n-l)th field. When 
interpolation value M is judged as being an intermediate 

10 value or the difference between the image signals of the 
fn-i;th and (n+i;th fields is equal to or greater than 
the reference value, interpolation pixel value IN is 
generated by intra-field interpolation that uses the 
image signal of the nth field. When pixel value S of the 

15 image signal of the (n+l)th field is judged as being an 
intermediate value and the difference between the image 
signals of the (n-l)tii and (n+l)th fields is below the 
predetermined value, interpolation pixel value IN is 
generated by inter-field interpolation that uses the 

20 vertical high-frequency components of the image signal 

of the (n+1) th field. 

An interpolation operation performed by the image 
signal processing circuit with the above construction is 
explained using specific examples below. FIG. 6 shows an 
25 image in which a black-colored strip area runs between 
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a gray-colored area and a white-colored area in a slanting 
direction. It is assumed that the gray level of the 
gray-colored area is 128, the gray level of the 
white-colored area is 255, and the gray level of the 
5 black-colored ~rea is 0. The image is moving to the right 
by two pixels per field. 

This image is interpolated in the following manner. 
The reference value used in the difference judgement 
circuit 5 is set at 7 for the sake of convenience. 

10 In FIG. 6, an area . enclosed with a broken-line box 

is a vertical line of interest in the nth field. Since 
the image is moving to the right by one pixel per field, 
a vertical line of interest which is located at the same 
position in the preceding field is a set of pixels enclosed 

15 by a solid-line box in FIG. 7(a) . Note that pixels shown 
by broken-line circles do not actually exist in these 
fields, since the image is an interlaced image. 

Likewise, a vertical line of interest that is located 
at the same position in the following field is a set of 

20 pixels enclosed by a solid-line box in FIG. 7(c). FIG. 
7 (b) shows the vertical line of interest in the nth field, 
where IN denotes a pixel to be interpolated. Here, 
difference (\SB-PB\) of the values of the pixels in the 
(n+1) th and (n-1) th fields which are located at the same 

25 position as the pixel to be interpolated is 1 128-255\=12 7. 
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Since 127>7 ( 7being reference value R) , a=l . In this case, 
interpolation pixel value IN is determined using pixel 
values of the vertical line of interest in the nth field 
according to Equation 2, so that IN=0. 
5 This interpolation result correlates well with the 

original image of FIG. 6, indicating that appropriate 
interpolation was carried out. If the conventional 
interpolation technique is used, on the other hand, the 
intermediate value is 128 and interpolation pixel value 
10 IN is determined using Equation . 3, so that IN=63 . This 
causes the occurrence of noise, indicating that the 
interpolation was not successful. 

The above example deals with the case where the image 
that slants from the top right to the bottom left is moving 
15 to the right. However, favorable interpolation can also 
be performed in the case where the same image is moving 
to the left. Likewise, favorable interpolation can be 
performed in the case where an image that slants from the 
top left to the bottom right is moving to the right or 
20 to the left. These effects can be obtained because 

whenever the difference between pixel value PB of the 
(n-1) th field and pixel value SB of the (n+1) th field is 
equal to or greater than the reference value, a=l is set 
and intra-f ield interpolation is automatically performed 
25 regardless of which field the intermediate value belongs 
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to. In other words, when the temporal change of the value 
of the pixel at the same position is large, intra-field 
interpolation is executed so as to produce a natural- 
looking image that changes smoothly. 
5 The following explains interpolation performed on 

other two types of images, to further examine the effects 
of this embodiment. 

FIG. 8 shows an image that sharply slants from the 
top right to the bottom left. This image is moving to the 

10 left by one pixel per field. This being so, vertical lines 
of interest in the fn-i;th, nth, and fn+ljth fields are 
shown by solid-line boxes in FIGS . 9 (a) to 9 (c) . From this 
drawing, | PB-SB\=127>7 ( 7 being reference value J?) , so that 
a=l . Kence intra-field interpolation is performed in 

15 this case too, which produces a favorable interpolated 
image . 

FIG. 10 shows an image that slants from the top left 
to the bottom right with' a relatively gentle slope (by 
one pixel in the vertical direction against three pixels 

20 in the horizontal direction) . This image is moving to the 
left by six pixels per field. This being so, vertical 
lines of interest in the (n-l)-th, nth, and (n + l)th fields 
are shown by solid-line boxes in FIGS. 11(a) to 11(c). 
In this case too, a-l, so that intra-field interpolation 

25 is performed which produces a favorable interpolated 
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image . 

On the other hand, if the conventional technique is 
used to interpolate the image of FIG. 8 or 10, the pixel 
of the (n-1) th or (n+1) th field is set as an intermediate 

5 value, so that inter-field interpolation that uses the 
high-frequency components of the image signal of the 
(n-l)thor Cn+i; th field is performed. The result of such 
interpolation is obviously not 0. This causes the 
occurrence of noise, unlike the present embodiment. 

10 as can. be seen from the examples shown in FIGS. 8 

and 10, when a slope of an image is gentler, by increasing 
the moving speed of the image in the horizontal direction 
the pixel patterns of the vertical lines of interest in 
the Cn-JJth, nth, and (n+i;th fields become identical, 

15 as a result of which the interpolation conditions become 
the same. In such a case, if the slope is equal to or 
greater than one pixel in the vertical direction against 
k pixels in the horizontal direction, noise occurs when 
the conventional interpolation technique is used. 

20 A method of setting the reference value in the 

difference judgement circuit 5 is explained below. 
Reference value R in the difference judgement circuit 5 
is used to judge whether the input image signal is a still 
image or a moving image. Therefore, if there is even a 

25 slight inter-frame difference, it is fundamentally 
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desirable to treat the image signal as a moving image. 
However, when the image is expressed in 256 levels of gray, 
the image can be judged as being a still image if the 
difference is 3 to 4 which is a little higher than 1% of 
5. the total gray scale. In reality, however, noise is 
usually present in the image signal, so that the difference 
tends to be still larger even when the image is a complete 
still image. Consider noise in accordance with a normal 
distribution with mean value of 0 and standard deviation 

10 of (7. When the image signal is expressed in 256 levels 
of gray as in this embodiment, a is typically about 2 to 
4. In accordance with the normal distribution, the 
probability of the noise being -a to +(7 is 68.27%, the 
probability of the noise being -2xa to 2x a is 95. 45%, and 

15 the probability of the noise being -3xa to 3x a is 99. 73%. 
This being the case, if the difference is larger than 2 
a or 3 a by a little more than 1% of the total gray scale, 
it is preferable to judge the image as being a moving image, 
rather than judging that the image contains noise. 

20 Therefore, if a is 2 to 4, 2xa is 4 to 8 and 3xO is 6 
to 12 . Hence reference value R is preferably 7 to 16, which 
can be obtained by adding 3 to 4 that are a little higher 
than 1% of the total gray scale to the values of 2 C to 
3 a , i.e. 4 to 12. 

25 Note that if the S/N ratio (the value of a) of each 

36 

BNSDOCID: <WO 0237847A1_I_> 



WO 02/37847 



PCT/JP01/09371 



input image signal is known, reference value J? can be 
optimally set for each individual signal according to the 
above calculations. Here, a small value is set when the 
S/N ratio is high, whereas a large value is set when the 
5 S/N ratio is low. 

Also, while in this embodiment the inter-frame 
difference is calculated as the difference between one 
pixel of the (n-l)-th. field and one pixel of the (n + i;th 
field, instead the difference calculated using the 
10 average value of the pixel and its neighboring pixels of 
each of the two fields may be compared with reference value 
R. In such a case, when j denotes the number of pixels 
used to calculate the average, the mean value of noise 
in the average is unchanged at 0. When the above a is 
15 used, the standard deviation is a/sqrt(j) (sqrt(j) is the 
square root of j). if j*=9, the standard deviation is O 
/3. Accordingly, when a is 2 to 4, 2x O is 2 to 2 and 3x 
a is 2 to 4. 2 a to 3 a are 1 to 4, so that the influence 
of noise decreases . Hence reference value R is preferably 
20 4 to 8, which can be obtained by adding 3 to 4 to these 
values in the same way as above. 

Depending on the degree of influence of noise, there 
is a danger that the signal itself may end up being treated 
as noise. The method of comparing the difference of the 
25 average pixel value of both fields with reference value 
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R is effective in this sense, as it reduces the influence 
of noise. 

(Second Embodiment) 

5 FIG. 12 shows a construction of an image signal 

processing circuit that is the second embodiment of the 
invention. In the first embodiment, intra-field 
interpolation is automatically performed when output a 
of the difference judgement circuit is 1. This being so, 

10 flicker or unnaturalness may be seen in the resulting image 
at the point where inter-field interpolation was switched 
to intra-field interpolation- To overcome this problem, 
the image signal processing circuit of the second 
embodiment generates a weighting factor based on output 

15 a of the difference judgement circuit, and weights and 
adds together intra-field interpolation and inter-field 
interpolation. In this way, the change between inter- 
field interpolation and intra-field interpolation 
becomes blurry, with it being possible to prevent the 

20 unnaturalness of the image. 

In FIG. 12, the field memories 1 and 2, the 
interpolation circuit 3, a difference judgement circuit 
15, the double-speed conversion memories 6 and 7, and the 
selection circuit 8 have the same constructions as those 

25 shown in FIG. 1, so that their explanation has been omitted . 
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An intermediate value selection circuit 14, unlike the 
intermediate value selection circuit 4 in FIG. 1, does 
not receive output a of the difference judgement circuit 
15. In other words, the intermediate value selection 
5 circuit 14 has the same construction as the conventional 
circuit shown in FIG. 19. 

A specific example of this circuit is shown in FIG. 

13. 

Apart from these circuits, the image signal 
10 processing circuit of this embodiment further includes 
a weighting factor setting circuit 11, a 
weighting/addition circuit 12, and an interpolation 
circuit 9. 

The weighting factor setting circuit 11 calculates 
15 weighting factor jB, based on comparison result a of - the 
difference judgement circuit 15. The following two 
methods can be used to determine (3. 

The first method is as follows . The weighting factor 
setting circuit 11 operates a spatial low-pass filter 
20 (hereafter M LPF" ) for comparison result a- of the 

difference judgement circuit 15. As an example, when a 
pixel to be interpolated is a pixel shown by a diagonally 
shaded broken-line circle in FIG. 14, the spatial LPF is 
operated in a range enclosed by a broken-line box. 
25 Since broken-line pixels other than the diagonally 
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shaded one are. also pixels which are subjected to 
interpolation, a is calculated for each of these pixels, 
with the calculated values of a being set as aOO to a22 . 
This being so, J5 is calculated as 

5 

f3= ( (a00+a20+a'02+a22) 

+2x(al 0+a01+a21+al2) +4xall) /4 

The same calculation is used to find J3, in the case 

10 where the coefficient of the LPF or the range for which 
the LPF operates is varied. This method enables the value 
of a for each pixel to change smoothly. As a result, the 
change between inter-field interpolation and intra-f ield 
interpolation becomes not so distinct, thereby producing 

15. a natural-looking image. 

The second method is as follows. Here, output a of 
the difference judgement circuit 15 is not set at 0 or 
1. Instead, AL-D is computed where AL is the difference 
between pixel value PB of the fn-2 ) th field and pixel value 

20 SB of the (n + 1) th field and D is another predetermined 
value. If AZ-D^O, ct=0 is output. If AL-D>0, a=AL-D is 
output.. The weighting factor setting circuit 11 has 
predetermined value Z. The weighting factor setting 
circuit 11 determines jB in the following manner, with Z 

25 being a predetermined value. When a=0, J5=0. When azZ, 
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0=1 . When 0<a-<Z f (3 is set within a range of 0 to 1 such 
that the inequality will not change before and-after the 
conversion from a to /?. According to this method / the 
inter-frame difference for each pixel directly affects 
5 the value of /3, so that inter-field interpolation and 
intra-field interpolation are switched appropriately. 
This enables an image of high resolution to be obtained. 

The interpolation circuit 9 generates an 
interpolation signal from pixels of the nth field, using 
10 the image signal output from the field memory 1. The 
interpolation circuit 9 has the same construction as the 
interpolation circuit 3. In some cases, it is possible 
to omit the interpolation circuit 9 and apply the output 
of the interpolation circuit 3 to the weighting/addition 

15 circuit 12. 

The weighting/addition circuit 12 receives 
interpolation pixel value IN from the intermediate value 
selection circuit 14, interpolation signal R from the 
interpolation circuit 9 r and weighting factor 0 from the 

20 weighting factor setting circuit 11. The 
weighting/addition circuit 11 calculates 

Y=RxJ3+INx(1-J3) 

25 and outputs Y as the final interpolation pixel value . 
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The double-speed conversion memory 6 sequentially 
stores interpolation pixel values Y output from the 
weighting/addition circuit 12. The double-speed 
conversion memory 7 sequentially stores pixel values N 
5 of image signals output from the field memory 1. The 
selection circuit 8 alternately reads interpolation pixel 
values Y from the double-speed conversion memory 6 and 
pixel values N from the double-speed conversion memory 
7 and outputs them to the output terminal 20, in a period 

10 half the pixel period of the image signal input in the 
input terminal 10. In this way, a progressive scanned 
image signal is obtained in the output terminal 20. 

According to the above construction, the final 
interpolation pixel value is generated by weighting and 

15 adding together the interpolation pixel value generated 
by the conventional intermediate value selection circuit 
and the intra-field interpolation value, based on the 
inter-frame difference. This suppresses the occurrence 
of conversion noise caused by the use of inter-field 

20 interpolation for a scene with large movement. Also, the 
change between intra-field interpolation and inter-field 
interpolation for each pixel becomes blur, by 
continuously changing the weighting factor in accordance 
with the judgement result of the difference judgement 

25 circuit. As a result, a favorable progressive scan 

42 

BNSDOCID: <WO 0237B47A1_I_> 



WO 02/37847 



PCT/JP01/09371 



conversion result can be attained. 

(Third Embodiment) 

FIG . 15 shows an image signal processing circuit that 
5 is the third embodiment of the invention. The 

construction of this image signal processing circuit is 
basically the same as that of the first embodiment, except 
for the following. The image signal processing circuit 
of this embodiment is equipped with an edge detection 
10 circuit 131 for the image of the (n-1) th field and an edge 
detection circuit 132 for the image of the (n+1 ) th field. 
When any of the edge detection circuits 131 and 132 detects 
an edge, a gate of a gate circuit G is closed and judgement 
result a of the difference judgement circuit 5 is set at 
15 0. As shown in FIG. 16, the edge detection circuit 131 
detects whether an edge that extends in the horizontal 
direction is present between the pixel row of the mth line 
and the pixel row of the fm-i; th or (m+l)th line in the 
(n-1) th field. Likewise, the edge detection circuit 132 
20 detects whether an edge extending in the horizontal 

direction is present between the mth line and the (m- 
i;th or <m+l)th line in the (n+l)th field. The detection 
may be performed using a known edge detection technique. 
This embodiment employs the following technique as one 
25 example. In FIG. 16, the difference in value of any two 
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vertically adjacent pixels between the pixel row of the 
mth line and the pixel row of the (m-1) th line-is calculated. 
If the calculated differences have the same sign, an edge 
is judged as being present. 
5 When an e^ge exists in any of the fields, difference 

judgement result a is set to 0. In this way, images such 
as the following can be interpolated favorably. 

FIG. 17 shows an image in which a black-colored 
horizontal line with luminance of 0 is placed in the center 
10 against the white-colored background . Suppose this image 
is moving downward. The moving speed is very slow, so that 
a gray-colored image is present at the same line (mth line) 
with the lines below being white even in the (n + Dttx field, 
as shown in FIG. 18. When the construction of the first 
15 embodiment (see FIG. 1) is used in such a case, a=l since 
\PB-SB\ = \0-32\=32>7 (reference value R) , so that intra- 
field interpolation is performed. The resulting 
interpolation value is 255+240/ 2=147 . 5 , which is 
expressed by a light gray-colored line. However, when the 
20 image transition of the preceding and following fields 
is considered, this interpolation is clearly not 
desirable. On the other hand, if the conventional 
interpolation technique is used, the pixel of the (n + i;th 
field is set as the intermediate value, so that a blackish 
25 line is produced. Thus, the conventional interpolation 
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is preferable in this case. Accordingly, to interpolate 
an image that has a horizontally-extending edge, the 
conventional technique should be adopted instead of the 
method of the first embodiment- For this reason, if a 
5 horizontally-extending edge is detected, difference 
judgement result a is automatically set to 0 so as to 
execute the conventional interpolation, in the third 
embodiment . 

The present invention is not limited to the above 
10 described constructions- Various modifications are 

possible so long as they do not depart from the scope of 
the invention. Example modifications are listed below. 

(1) When the difference judgement circuit calculates 
an inter-frame difference, in each of the (n-l)th and 

15 (n + 1 )tli fields the average value of a pixel group made 
up of pixel PB or SB corresponding to the pixel in the 
nth field to be interpolated and neighboring pixels 
thereof may be calculated, with the difference between 
the two averages being set as the inter-frame difference. 

20 In so doing, the influence of noise of the input image 
signal upon the judgement result is reduced, with it being 
possible to improve the quality of the converted image. 

(2) In the above embodiments, the inter-frame 
difference is calculated as the difference in value of 

25 pi:rels PB and SB in the (n-l)th and (n+1 )th fields that 
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corr-espond to the pixel in the nth field which is to be 
interpolated. However, the inter-frame dif f erence'may be 
calculated as the difference between pixel values PB and 
SB in the (n-3) th and (n+3) th fields or as the difference 
5 between pixel value PB and SB in the (n-5)th and fn + 5;th 
fields. In other words, pixels of any two fields can be 
used as long as the change of the image is detected. A 
method of taking a difference using two or more preceding 
fields and two or more following fields is also applicable, 
10 such as by calculating the difference between the weighted 
average of the corresponding pixels in the (n-1) th, 

fn-3;th, and (n-5;th fields and the weighted average of 
the corresponding pixels in the (n + 1) th, (n-f3jth, and 

(n+5) th fields. 

15 (3) The inter-frame difference is described as being 

calculated in absolute value in the above embodiments, 
but it may be calculated with a sign, where PB>SB and PB<SB 
are discriminated. In such a case, two reference values 
are set so that, for example, the reference value in the 

20 case of PB>SB is larger than the reference value in the 
case of PB-<SB, or smaller than the reference value in the 
case of PB<SB. Such assigning hysteresis to the reference 
values enables interpolation to be carried out more 
flexibly . 

25 
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INDUSTRIAL APPLICABILITY 

The present invention can be used to- convert an 
interlaced image signal to a progressive scanned image 
signal while suppressing the occurrence of noise even when 
the image is a moving image. Hence the conventional 
problem of j aggies is reduced in the resulting progressive 
scanned image. 
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CLAIMS 

1. An image signal processing apparatus for 
converting an image signal of a first scanning format to 
5 an image signal of a second scanning format, comprising: 
main interpolating means for interpolating a 
scanning line between any two adjacent scanning lines in 
a present field that corresponds to the image signal of 
the first scanning format, by selectively executing two 
10 interpolation methods for each target pixel which 

constitutes the scanning line to be interpolated, the two 
interpolation methods being inter-field interpolation 
that uses pixels of a field preceding the present field 
and a field following the present field, and intra-field 
15 interpolation that uses pixels in the present field which 
are in a neighborhood of the target pixel; 

change detecting means for detecting a change of an 
image, by referring to an image signal of the preceding 
field and an image signal of the following field; 
20 automatic interpolating means for prohibiting, 

depending on a detection result obtained by the change 
detecting means, the main interpolating means to select 
and execute one of the two interpolation methods, and 
instead automatically executing a specific interpolation 
25 method; and 
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image signal outputting means for alternately 
outputting scanning lines of the image signal of the 
present field and interpolated scanning lines obtained 
by the combination of the main interpolating means, the 
5 change detecting means, and the automatic interpolating 
means . 



2. The image signal processing apparatus of Claim 

1, 

wherein the change detecting means detects an extent 
to which the image changes with time, and 

the automatic interpolating means automatically 
executes the intra-f ield interpolation, when the detected 
extent is greater than a reference value. 



10 



15 



3. The image signal processing apparatus of Claim 

2, 

wherein the first scanning format is interlace 
scanning, and the second scanning format is progressive 

20 scanning, and 

the image signal outputting means outputs a 
progressive scanned image signal of one frame, responsive 
to an interlaced image signal of one field. 



25 



4. The image signal processing apparatus of Claim 
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3, 

wherein the change detecting means calculates a 
difference between a value of a pixel in the preceding 
field that positionally corresponds to the target pixel 
5 and a value of a pixel in the following field that 

positionally corresponds to the target pixel, and judges 
whether the difference is greater than the reference 
value . 

5. The image signal processing apparatus of Claim 

4, 

wherein when the present field is an nth field, the 
preceding field is an (n-l)th. field and the following field 
is an (n+l)th field, 

the main interpolating means is equipped with a 
series circuit of at least two field memories, and 

when the image signal of the (n+1) th field is being 
input in a field memory of a first stage in the series 
circuit, the image signal of the nth field is being output 
from the field memory of the first stage and the image 
signal of the <n-l)th field is being output from a field 
memory of a second stage in the series circuit. 

6. The image signal processing apparatus of Claim 
25 5, 
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wherein the main interpolating means includes: 
an intermediate value selecting unit for selecting 
an intermediate value from (a) the value of the pixel in 
the <n-l) th field that positionally corresponds to the 
5 target pixel, (b) the value of the pixel in the (n+1) th 
field that positionally corresponds to the target pixel, 
and (c) an average value of pixels in the nth field that 
are adjacent to the target pixel, the intermediate value 
being smaller than one of remaining two values but greater 
10 than a different one of the remaining two values; 

a first inter-field interpolating unit for obtaining 
high-frequency components from values of pixels in the 
(n-1) th. field that are made up of the pixel positionally 
corresponding to the target pixel and neighboring pixels 
15 thereof, and calculating a first interpolation value for 
the target pixel using the high-frequency components; 

a second inter-field interpolating unit for 
obtaining high-frequency components from values of pixels 
in the (n+1) th field that are made up of the pixel 
20 positionally corresponding to the target pixel and 

neighboring pixels thereof, and calculating a second 
interpolation value for the target pixel using the 
high-frequency components; 

an intra-field interpolating unit for calculating 
25 a third interpolation value for the target pixel, using 
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an average value of the pixels in the nth field that are 
in the neighborhood of the target pixel; and 

a selecting unit for selecting one of the first 
inter-field interpolating unit, the second inter-field 

5 interpolating unit, and the intra-field interpolating 
unit based on the intermediate value selected by the 
intermediate value selecting unit, and outputting an 
interpolation value calculated by the selected 
interpolating unit to the image signal outputting means 

10 as a pixel value of the target pixel. 

7. The image signal processing apparatus of Claim 

4, 

wherein the reference value is set at a value in a 
15 range of 7 to 16, when the image is expressed in 256 levels 
of gray. 

8. The image signal processing apparatus of Claim 

3, 

20 wherein the change detecting means calculates a 

difference between an average value of a pixel group in 
the preceding field and an average value of a pixel group 
in the following field, and judges whether the difference 
is greater than the reference value, each pixel group being 

25 made up of a pixel that positionally corresponds to the 
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target pixel and neighboring pixels thereof. 

9. The image signal processing apparatus of Claim 
4, further comprising: 
5 edge detecting means for detecting an edge in the 

preceding field or the following field, the edge being 
parallel to a scanning line that includes a pixel 
positionally corresponding to the target pixel; and 
stopping means for temporarily stopping the 
10 automatic interpolating means from prohibiting the main 
interpolating means, when the edge detecting means 
detects the edge. 



10. An image signal processing apparatus for 
15 converting an image signal of a first scanning format to 
an image signal of a second scanning format, comprising: 

main interpolating means for interpolating a 
scanning line between any two adjacent scanning lines in 
a present field that corresponds to the image signal of 
20 the first scanning format, by selectively executing 

inter-field interpolation and intra-field interpolation 
to calculate a first interpolation value for each target 
pixel which constitutes the scanning . line to be 
interpolated, the inter-field interpolation using pixels 
25 of a field preceding the present field and a field 
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following the present field, and the intra-field 
interpolation using pixels in the present field that are 
in a neighborhood of the target pixel; 

sub-interpolating means for executing the intra- 

5 field interpolation to calculate a second interpolation 
value for the target pixel, using the pixels in the present 
field that are in the neighborhood of the target pixel; 

change detecting means for detecting a change of an 
image, by referring to an image signal of the preceding 

10 field and an image signal of the following field; 

weight setting means for setting a first weight by 
which the first interpolation value should be multiplied, 
and a second weight by which the second interpolation value 
should be multiplied; 

15 weighting/adding means for multiplying, depending 

on a detection result obtained by the change detecting 
means, the first interpolation value by the first weight 
and the second interpolation value by the second weight, 
and calculating a sum of the weighted first interpolation 

20 value and the weighted second interpolation value, the 
sum being set as a value of the target- pixel; and 

image signal outputting means for alternately 
outputting scanning lines of the image signal of the 
present field and interpolated scanning lines obtained 

25 by the combination of the main interpolating means, the 
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sub-interpolating means, the change detecting means , the 
weight setting means, and the weighting/adding means. 

11. The image signal processing apparatus of Claim 

5 10, 

wherein the first scanning format is interlace 
scanning, and the second scanning format is progressive 

scanning, and 

the image signal outputting means outputs a 
10 progressive scanned image signal of one frame, responsive 
to an interlaced image signal of one field. 

12. The image signal processing apparatus of Claim 

11, 

15 wherein the change detecting means calculates a 

difference between a value of a pixel in the preceding 
field that positionally corresponds to the target pixel 
and a value of a pixel in the following field that 
positionally corresponds to the target pixel, and judges 

20 whether the difference is greater than the reference 
value . 

13. The image signal processing apparatus of Claim 

12, 

wherein the weight setting means sets the first 



55 



BNSDOCID: <WO 0237847A1J_> 



WO 02/37847 



PCT/JP01/09371 



weight and the second weight, in accordance with the 
difference obtained for the target pixel and differences 
obtained for pixels in the present field that are subjected 
to interpolation and are in a neighborhood of the target 
5 pixel . 

14. The image signal processing apparatus of Claim 

12, 

wherein the weight setting means sets the first 
10 weight and the second weight, in accordance with the 
difference calculated by the change detecting means. 

15. An image signal processing apparatus for 
interpolating necessary scanning lines, when converting 

15 an interlaced image signal to a progressive scanned image 
signal, comprising: 

a first interpolating circuit for generating an 
interpolation value M for each target pixel which 
constitutes a scanning line to be interpolated in an nth 

20 field that corresponds to the interlaced image signal, 
by performing interpolation within the nth field; 

an intermediate value selecting circuit for 
selecting an intermediate value from (a) a value P of a 
pixel in an (n-1) th field that positionally corresponds 

25 to the target pixel, (b) a value S of a pixel in an (n+l)t.h 
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field that positionally corresponds to the target pixel, 
and (c) the interpolation value M, the intermediate value 
being smaller than one of remaining two values but greater 
than a different one of the remaining two values; 
5 a difference judging circuit for calculating a 

difference AL using an image signal of the (n-1) th field 
and an image signal of the (n+1) th field, and outputting 
a judgement result based on a comparison between the 
difference AL and a reference value R; and 
10 a target pixel generating circuit for outputting, 

as a value of the target pixel, (a) the interpolation value 
M, when the difference judging circuit judges ALtR or the 
intermediate value selecting circuit selects the 
interpolation value M, (b) a first interpolation value 
15 for the target pixel which is generated by performing first 
inter-field interpolation that uses at least the image 
signal of the (n-l)th field, when the difference judging 
circuit judges AL<R and the intermediate value selecting 
circuit selects the value P, and (c) a second interpolation 
20 value for the target pixel which is generated by performing 
second inter-field interpolation that uses at least the 
image signal of the (n+1) th field, when the difference 
judging circuit judges AL*R and the intermediate value 
selecting circuit selects the value S. 

25 
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16. The image signal processing apparatus of Claim 

.15, 

wherein the target pixel generating circuit 
includes : 

5 a first high-frequency component extracting circuit 

for extracting high-frequency components from pixels in 
the (n-1) th field which are consecutive in a vertical 
direction; 

a second high-frequency component extracting 
10 circuit for extracting high-frequency components from 
pixels in the fn+2)th field which are consecutive in the 
vertical direction; 

a second interpolating circuit for generating a 
third interpolation value for the target pixel, by 
15 performing interpolation within the nth field; 

a first calculating circuit for performing a 
calculation, using the high-frequency components 
extracted by the first high-frequency component 
extracting circuit and the third interpolation value; and 
20 a second calculating circuit for performing a 

calculation, using the high-frequency components 
extracted by the second high-frequency component 
extracting circuit and the third interpolation value, and 
a result of the calculation by the first calculating 
25 circuit is the first interpolation value, whereas a result 



58 



BNSDOCID: <WO 0237847A1_I_> 



WO 02/37847 



PCT/JP01/09371 



of the calculation by the second calculating circuit is 
the second interpolation value. 

17 . An image signal processing apparatus for 
5 interpolating .-ecessary scanning lines, when converting 
an interlaced image signal to a progressive scanned image 
signal, comprising: 

a first interpolating circuit for generating an 
interpolation value M for each target pixel which 
10 constitutes .a scanning line to be interpolated in an nth 
field that corresponds to the interlaced image signal, 
by performing interpolation within the nth field; 

an intermediate value selecting circuit for 
selecting an intermediate value from (a) a value P of a 
15 pixel in an (n-l)th field that positionally corresponds 
to the target pixel, (b) a value S of a pixel in an (n+1) th 
field that positionally corresponds to the target pixel, 
and (c) the interpolation value M, the intermediate value 
being smaller than one of remaining two values but greater 
20 than a different one of the remaining two values; 

a difference judging circuit for calculating a 
difference AL using an image signal of the (n-l)th field 
and an image signal of the (n+l)th field, and outputting 
a judgement, result based on a comparison between the 
25 difference AL and a reference value i?; 
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a first high-frequency component extracting circuit 
for extracting high-frequency components from pixels in 
the (n-l)th field which are consecutive in a vertical 
direction; 

5 a second high-frequency component extracting unit 

for extracting high-frequency components from pixels in 
the (n+1) th field which are consecutive in the vertical 
direction; 

a second interpolating circuit for generating a 

10 first interpolation value for the target pixel, by 
performing interpolation within the nth field; 

a first calculating circuit for performing a 
calculation, using the high-frequency components 
extracted by the first high-frequency component 

15 extracting circuit and the first interpolation value; 

a second calculating circuit for performing a 
calculation, using the high-frequency components 
extracted by the second high-frequency component 
extracting circuit and the first interpolation value; 

20 a selecting circuit for selecting and outputting (a) 

the interpolation value M, when the intermediate value 
selecting circuit selects the interpolation value M, (b) 
a result of the calculation by the first calculating 
circuit, when the intermediate value selecting circuit 

25 selects the value P, and (c) a result of the calculation 
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by the second calculating circuit, when the intermediate 
value selecting circuit selects the value S; 

a third interpolating circuit for generating a 
second interpolation value for the target pixel, by 
5 performing interpolation within the nth field; 

a weight setting circuit for setting a first weight 
by which an output value of the selecting circuit should 
be multiplied and a second weight by which the second 
interpolation value should be multiplied, according to 
10 the judgement result by the difference judging circuit; 
and 

a weighting/adding circuit for multiplying the 
output value of the selecting circuit by the first weight 
and the second interpolation value by the second weight, 
15 and outputting a sum of the weighted values as a value 
of the target pixel. 



18. The image signal processing apparatus of Claim 

17, 

wherein the difference judging circuit calculates 
a difference between the value P and the value S as the 
difference AL, and outputs the judgement result based on 
the comparison between the difference AL and the reference 
value R. 



20 



25 
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19. The image signal processing apparatus of Claim 

17, 

wherein the difference judging circuit calculates 
a difference between an average value of a pixel group 
5 in the (n-l)th field and an average value of a pixel group 
in the (n-hl)th field as the difference AL, and outputs 
the judgement result based on the comparison between the 
difference AL and the reference value R, each pixel group 
being made up of a pixel that positionally corresponds 
10 to the target pixel and neighboring pixels thereof. 

20. The image signal processing apparatus of Claim 

17, 

wherein the difference judging circuit outputs 1 
15 when AL>R, and outputs 0 when AL<R, and 

the weight setting circuit calculates a value F , and 
sets the value F as the second weight and a value (1- 
F) as the first weight, the value F being obtained by 
(a) weighting output values of the difference 
20 judging circuit which correspond to pixels in a 

predetermined range in the nth field, according to a 
distance of each of the pixels from the target pixel, the 
pixels being made up of the target pixel and pixels which 
are subjected to interpolation and are in a neighborhood 
25 of the target pixel, and 
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(b) adding the weighted output values together. 

21. The image signal processing circuit of Claim 17, 
wherein the difference judging circuit outputs a 
value G, G being a value in a range of 0 to 1 depending 
5 on a value (R-AL) when ALzR, and being 0 when AL~tR, and 
the weight setting circuit sets the value G as the 
second weight, and a value (1-G) as the first weight.. . 
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